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ABSTRACT 

This paper describes recent research on the topic of 
assessment that has been conducted at Project Zero at the Harvard 
Graduate School of Education. It is argued that assessment built 
around an interesting and challenging project that explores a 
particular domain (such as music, writing, drawing, mathematics, 
science, or programming) offers an important alternative to 
traditional standardized tests. Such assessment instruments are known 
as "domain projects." This view of assessment is based on the theory 
of multiple intelligences which claims that human beings have evolved 
ac least seven forms of knowing or processing information. These 
intelligences are structurally independent, but function in concert. 
An assessment must elicit use of the materials of a given domain and 
mobilize a number of different intelligences. The Arts PROPEL Project 
in the Pittsburgh schools uses student portfolios and domain projects 
to assess artistic development in secondary school students. The 
Catalyst Project, an investigation of how children and adults learn 
with microcomputers, is another effort developing domain project 
assessments. The Catalyst Project illustrates ways in which 
assessment can move beyond tests, measurement, and large-group 
comparisons to assessments that capture aspects of student 
performance that may otherwise be overlooked. (SLD) 
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Project Zero, Harvard Graduate School of Education 



Introduction 

This paper reviews recent research thai has 
been ccnduclc\l at Project Zero at the Harvard 
Graduate School of Education on the topic of 
assessment. In the paper we argue that an 
assessment built around an interesting and 
challenging project that explores a particular domain 
(such as music, writing, drawing, mathematics, sci- 
ence, or programming)offcrsan important alternative 
to traditional standardized tests. As students work 
through such projects, they reveal most vividly the 
skills and aptitudes that we want to assess. We refer to 
the^c asscbsment instruments as domain projects. 

'^^c theory of mul tiple i ntell igences pre vides much 
of the conceptual underpinningsofour view of assess- 
ment, and the paper begins with a brief synopsis of 
this theory. Next, we review examples of domam 
projects underdevelopment \n two different research 
initiatives at Project Zero— Arts PROPEL and Cata- 
lyst. Drawing from these examples, we list the salient 
characteristics of this project-based assessment and 
outline the design of one such project that uses com- 
puter technology. 

Th.e paper concludes by indicating directions for 
future research and development. 

Assessment at Project Zero 

For the past twenty years. Project Zero has taken as its 
research agenda the systematic study of children and 
their symbi)l-using skills by exploring such diverse 
areas as drawing, mctaphoric language, musical abil- 



ity, storytelling, written language, mathematics and 
computer programming, lliediversity of this research 
is responsible in part for the development of the view 
of human cognition that we call the theory of "mul- 
tiple intelligences" (Gardner, 1983). 

With respect to assessment, we draw two con- 
clusionsfrom this particular view of human cognition. 
First, an evaluation of achievement or aptitude must 
be specified within a domain of human activity. Sec- 
ond, the assessment must be drawn based on a true 
performance in that domain. In this section, we will 
build the argument by reviewing the central ideas of 
multiple intelligences and then outlining the implica- 
tions of the theory for assessment. 

Multiple Intelligences 

1 he theory of multiple intelligences claims that human 
beings have evolved at least seven different forms of 
knowing or processing information. These different 
fomis, called "intelligences," include the skills for 
manipulating language, logic and mathematics, mu- 
sical ability, spatial information, bodily kinesthetic 
information, knowledge of other persons (interper- 
sonal), and knowledge of oneself (intra personal). All 
nonnal human beings possess some capacity in each 
of these intellectual spheres, but the interaction of 
genetic and environmental factors produce markeci 
differences in the profiles of the various intelligences 
in individuals. 

This theory wasdesigned to serve twogoals. (1 ) to 
synthesize a large set of findings about human cog- 
nition, including neurobiological evidence, cross-cul- 
tural analysis, and developmental milestones; and 
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(2) to provdo an allcrn.Uivc to the widespread bchot 
in a binglc faculty— intolli^^oncc — thai can be ad- 
equately asM?st>ed by pa{xr-and-penLil "intelligence 
tests." 

In thetheor) of multiple intelligences, the specific 
skills of human cognition— the intelligences— are 
mobilized for solving problems within particular do- 
mains of activity. Each intdli^erice is an evolved 
biopsychological potential that is maiafested as a 
particularcognitiveskill. hi contrast, theiio>"i/rt of that 
potential isdefined by the culture as an arena in v\ hich 
the variouscognitivchkiUbare mobilized, h^thetheory 
of multiple intelIi^;cnLe:j, ^^I'^^lj t»is of problem solving 
a\|uiresconsideMtionafbQthiheLOgnitivc functioning 
of the intelligences (and their combination) and the 
context of a domain specified within a particular cul- 
ture. 

The theory of multiple intelligences stipulates 
that the various intelligences are independent. For 
instance, when an individual display sa high degreeof 
competence wilhone intelligence, this ability does not 
imply similar competencies in other areas. Similarly, 
disability in one intelligence does not imply disabili- 
ties in the others. 

Althuugh the intelligences are independently 
structured in this way, they do not function indepen- 
deiUly. Any reasonably complex adult task requires 
the simultaneous functioning of several of the intelli- 
gences. Fur example, the task of writing a research 
paper ♦■pakcs primary use of the ling^iibtic intelligence, 
but i t also i ^ps the logical-mathematical intelligence at 
the same time. Playing the violin for an audience — 
firstandforemostamuskaltask-albomakesdemands 
on bodily-kmesthcticand interpersonal faculties. How 
an individual combines these separate intelligences is 
part of that individual's personal endow ment, just as 
are the intelligences themselves. 

These two outcomes of the theory of multiple 
intelligences— that the intelligences are indeponui nt 
and that they operate in concert— h.is important im- 
plications for the problem of assessment. First, an 
assessnKMU must pose problems in which individuals 
work with the actual materials of the domain being 
examined. Second, a complete assessment must posL 
a number of problems that yield to a variety of solu- 
tions in order to reveal an accurate picture of the 
talents and skills of a giv en individual. 

To illustrate the firs^ point, consider the task of 
assessing an individual's musieul competence, if the 



assessment consists of a number of questions in a 
multiple-choice format, the assessment is less a mea- 
sure of the musical intelligence and moreameasureof 
linguistic facility or test-taking skill. As an alternative, 
the assessment might ask the student to compose an 
end ing to a simple melody. To tackle this problem, the 
student must manipulate musical notation, select 
musical sounds, and use musical terminology. In this 
ta.sk, the student makes demands directly on the 
musical intelligence — the problem is not filtered 
through a linguistic or logical-mathematical assess- 
ment inbtiument,asitisin the multiple-choiceexample. 
This is what we mean when we say that to evaluate an 
underlying intelligence, an assessment must pose 
problems that require the individual to manipulate 
the actual materials of thedomain of U intelligence. 
We must examine true performance and not just a 
verbalization of a problem solution. 

Second, the fact that cognition is composed of 
sev eral indepenuent intelligencesopcrating in concert 
implies that an assessment must pose a variety of 
problems that yield to different types of solutions if it 
is to establish a complete picture of the profile of 
intelligences for an individual. For instance, by asking 
a student to solve our music composition task, we do 
not learn much about that student's ability to write 
short stories. Similarly, we cai^not infer that individu- 
als who do not write well are equally disinclined to 
perform well on tasks that require interpersonal skills, 
spatial abilities, or musical prowess. Any simple task, 
even when it requir^^s genuine performance with the 
materials of a don ..n, does not reveal the complete 
profileof an individual's talent s. Therefore, a complete 
assessment of an individual must make demands on 
all the intelligences, not just a select few. 

Finally, the theory of multiple intelligences un- 
derscores the importance of the "personal" skills in 
daily life. Working cooperatively in a group is recog- 
nized as an important feature of many adult situa- 
tions, from manufacturing to family dynamics. Also, 
understanding one's self, the intrapersonal skill, is 
al>o highlighted in the theory. For ins'.ance, a strength 
m the musical realm may be underutilized by an 
individual whodoesnot fully understand that strength, 
wherctiS an individual with a strong intrapersonal 
intelligencemaybcbetterequipped to combine modest 
strengths or to compensate for weaknesses efficiently. 
A complete assessment should take both of theper sonal 
skills into account, and the assessments we describe 



O ■ 

ERLC 



below consistently fo.itnre both small-group collabo- 
ration and rclioction on learning. 

Assessment through Projects 

To summarize, assessments of ability and learning 
must engage students in performances in which they 
handle the actual materials of a ^iven domain and 
mobilize a number of the different intelligences. We 
believe that problems that meet both criteria can often 
be formatted c\sj7rojccts. 

At Project Zero, we have been devising a number 
of exemplar projects in a variety of domains. These 
projects are at once open-ended, structured, and on- 
. cntedto\vardsproducts.Inordertoposcrich,complex, 
andengagingproblems,theprojectsareopen-ended-^ 
they offer opportunities to find alternative solutions 
and unexpected outcomes using different strategies 
and different combinations of intelligences. At the 
same time, the projcctsare structured— the results can 
be analyzed in terms of what students are learning. 
Finally, as students work through projec*s, they are 
called on to create original products— songs, essays, 
drawings—and this gives them a stake in the outcome 
of the project. 

The products that sti. Jents create in working on a 
project are evaluated by the teacher and the student 
together. We follow the work of Collins and 
Frederiksen (1989) in desiginng these evaluations. 
Fir>t, the evaluations consider only the performances 
that reveal directly the skillsand competencies that we 
are interested in; again, we ask students to exhibit 
skills, and not simply to describe those skills. Second, 
the scope of each project is designed such that every 
skill that we are interested in is exhibited; we do not 
desigT\ evaluations that test only a sample of the 
desired skills. Finally^all of these criteria arearticulatai 
at theoutset of the project, making them transparent to 
the students. In the final section of die paper, we will 
return to these principles of problem design and 
evaluation. 

Currently, two research initiatives at Project Zero 
are developing specific examples of assessment 
projects. Arts PROPEL is designing instruments in the 
arts; and Project Catalyst has created a scries of com- 
puter-based projects. We will outline these project: in 
the next two sections. Following this, we will describe 
a project that we are developing for the Center for 
Technology in Education that embodies these several 
design principles. 



Domain Projects in Arts PROPEL 

Arts PROPEL is a five-year research effort sponsored 
by the Rockefeller Foundation. Its primary goal is to 
create and test new techniques lor fostering ard as- 
sessing artistic dx?velopment in secondary school 
students. The project brings together researchers from 
Project Zero and the Educational Testing Service and 
teachC-'-sof music, visual arts,and imaginative writing 
in the Pittsburgh public schools. 

Arts PROPEL has designed two assessment 
techniques for arts classrooms: portfolios and domain 

piojects. A portfolio isa collection of materials that the 
student assembles during the process of creating a 
finished piece and includes sketches, eariy drafts, aixi 
notes as well as the final piece itself. These selections 
may be supplemented with a wr.tten journal in which 
the student reflects on the process of creating the 
piece. 

It is the second technique, the domain project, that 
is directly relevant to the present discussion. Each 
domain project in Arts PROPEL is composed of a 
clearly defined set of classroom tasks that focus stu- 
dents on a central issue in the crt form. V/e v.m11 
illustrate Arts PROPELdomain projects with examples 
drawn from the domains of music and imaginative 
writing, but projects are also developed in the visual 
arts, lliese descriptions begin with r summary of the 
project along with a description of he products that 
the students create, T\^\s is followed by a discussion of 
the various assessment techniques which includes 
reflection exercises and teacher judgments. 

Sample Projecfs 

Musical Performance: Ensemble Critique 

in musical performance, rehearsal is the main avenue 
fordevelopinginstrumental skill. hia typical rehearsal 
session, the teacher leads a number of student instru- 
mentalists, guiding their development by pointing 
out errors, highlighting certain areas for additional 
private practice, adjiisting the ensemble sound, and 
suggesting stylistic interpretation. 

In the Ensemble Critique project, students begin 
to make judgments about their performances of the 
sort that were previously made by the teacher. At the 
beginning of the project, the teacher leads a discussion 
ofcritiqueand gives thestuaentsspecial scoringsheets 
that they will use to critique a performance. The class 
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then c\amiiu\s the s* ore of t'ho piece thoy will pLrfornv 
con^Joring the i>l)lL\ the key, and other iniporlanl 
iealures. 

Next, llie sludenb perform the piece as an on- 
^L^lblo and tape record llKir performance. They 
evaliiale their perfurmai e from memory; then they 
lisU ii to the tape and compare what they hear with 
what they remember. Finally, they fill out their score 
sheets at» a foi mal critique of the performance, focus- 
ing on both the perfornunce of their part as well as the 
entire ensemble. 

This pel formance and critique process is repeated 
two more tinges during the senK\ster. In later perfor- 
n la I n. OS, I udtnti^ can compare their performance with 
earlier record inj.;s. As the student musicians bccouK 
iiKreasingly pi oticient at the process of critique, they 
begin to take o\ er other tasks of the rehearsal, includ- 
ing conducting tiie ensemble in rehearsal, determin- 
ing which portions of the piece require additional 
attention, and even makmg stylistic changes in the 
performance. 

Assessment ot the Ensemble Critique project 
con:>ists of the reflection activities that students carry 
out at each of the three check points. As they fill out the 
critique score sheets, they assess the performances of 
individuals as well as the ensemble as a whole. The 
teacheralsoevaiuatcs these performances and students 
can compare their self-assessments with those of the 
teacher. With practice, students become more precise 
in iheir ability to evaluate the performance, and this 
preeiseevaluation in turn makes them more proficient 
in their ability to rehearse themselves. 

This project is not designed as an assessment of 
perfoimanco. Instead, it is an assessment of the stu- 
dents' ability to critique a performance and to adjust 
their rehearsal accordingly. In this project the students 
begin to share responsibility for decisions that are 
usually made by the director alone. 

Imaginotive Writing: Writing Dialog 

All students mid plays in English class but very few 
write them, in the typical class, for example, the plays 
of Shakespeare are treated as literatuie that can be 
studied and analyzed, not as scripts to be performed 
and interpietcd. The PROPEL project called Writing 
Dialog provides students with a set of structured 
activities that develop their skill at creating original 
dramatic dialogue. Brief passages from contemporary 



drama are examined and judged using the same crite- 
ria that are used to critique the students' work. 

The Writing Dialog project is conducted over 
seven class sessions ITiroughout these sessions, stu- 
dents are learning to articulate the criteria by which 
dialogues can be ciiticiued. In each session, wriiten 
work is read out loud and discussed. 

First, the teach :}r .ntroduces the project by circu- 
lating several clipboards around the class. Each dip- 
boar ' ' as written at the top a singl? line of dialogue 
anu each student pdds an additional line. When the 
sheet is filled, the class reads the resulting dialogues 
out loud and discuss the results. Next, working in 
pairs, students imagine a setting and write a simple 
scene with two characters that Kikes place in that 
setting. The students in each pair write alternate lines 
in the dialogue. Again, the class reads the scenes out 
loud and discusses the results. This process of writing 
and rewriting continues for several class sessions. 

All writing done for the project issa ved in a folder, 
and in this class session the students select a piece 
from that folder to work from, adding approximately 
ten lines of dialogue to the seer \ At the conclusion of 
the project, students review .heir collection of dia- 
logues. They recorci their observations of the changes 
they have seen in their own WTitingover the course of 
the project. 

In this project, students begin writing dialogues 
with no instruction. Tliey can then use these first 
efforts to begin to explore those features that make for 
a "good" dialogue — sense of character, scene, motiva- 
tion, and so on. As their dialogue writing continues, 
they cLlx^rate these criteria and practice using them to 
evaluate their own dialogues as well as dialogues 
from published plays. By looking back over their 
earlier work, students can see a general improvement 
through the project, they can also see that they have a 
deeper understanding of what makesa dialogue work. 
In this way, the project helps the students to use their 
own productions to construct the criteria they need 
later to reflect on their own work. 

Assessment in this project focuses on thecollcction 
of written material tha t the studcn tscreatc in the seven 
working sessions. At the end of the project, students 
evaluate their entire collection, looking fcrevidenceof 
their developing skill at v/riting dialogue. Tlus se»f- 
examinationisthen compared with the teacher's review 
of the same material. 



ERiC 



7 



^ho,^c sample proyxts, E.i<^iv.b\Q Cril'u-,io aiul 
VVriUng Pialci^, iiluslralc the broadlh ot projccls [h?A 
have been crealcd in Arls rKOPEL. Currcnlly, theso 
domain projecls, as well as a number of oihe'rs, are' 
bcinj; extensively tested in tiie riltsbun-h Pnblio 

Sclu)ols/^leyw^Ilbeavailab!e^urbruade^dil^xfnina- 
liouin 1090. 

Anolysis 

lb suninurize, PROPiiL projects are sets of activities 
that aic presented over the course of the aiiool year. 
Fach piujcct poses problems that students soWq by 
creating original work. In producing original ;vOik, 
thcstudentsu.setheworkofothLrsorreprodnctionsof 
master works for points of contrast. Through.out this 
process students critique their own work. 

Teachers can use the PROPKL projects to assc\^s 
suidenls by evaluating the fmal products, by docu- 
menting thechangein skills displaved over thecourbe 
of the project or between tuo projects, and by - .ea- 
suiing their students' growing abilities to rece;gni^e 
positiveandnegativeelementsin theirownwoik.The 
PROPl:L project assessments are not designed to 
measure static competencies nor to delernune pre- 
cisely what hasbecn "learned" inaspecjfic curriculum 
uni t. histead, they demonstrate learning over a period 
of time. 

Thr.M: projects are designed to incorporate th.e 
features of assessment drawn from the theory of 
nuilliple intelligences. The PROPFL donvnin pre fects 
require students to deploy a variety of iiUelligencesa^i 
they engage specific problems. Students produce a 
product in each project, such as a n\usical piece or a 
dramatic dialogue. They also work in groups through- 
out the project, featuring the interpersonal skiils'^of 
collaboration and group discussion, finally, the 
PROPEL tasks tap intrapersonal skill by asking stu- 
dents to reflect on their unique approach to the 
problems posed in that project. In the PROPHL model, 
ar.sessmentisthecontinuing processof taking stockof 
one'scurrent position and comparing that state to the 
desired state. As students become more sensitive to 
their currci.t state and how it compares with the 
des-red state, they begin to takeon more responsibility 
for their own learnmg. 

Second, the PROPEL projects provide students 
with multiple opportunities for problem solving. In 
this program assessmen I does not rest on the results of 
a single PROPEL project but is drawn from students' 



pei fo? mances over a series ot projects given through- 
cujt the year. 

Catalyst Projects 

CaUiIyst is a live-) car in\ estigation funded by the 
John and Mary R. Mai kle Foundation to explore how 
children and adults learn with microcomputers. We 
focused this investigation on the experiences of indi- 
viduals as they approached somearea of endeavor for 
th.e fn-st time, examining novices' performance in music 
r.nd visual art, and more recently in mathematics, 
writing, and computer programming. Since the diffi- 
culties that novices experience in various areas are 
well documented, we wondered if thecomputer could 
alleviate some of those problems We felt that this 
rosoanii question would shed some interesting light 
on the general issue of computer-aided learning. 

Thisinitiai research effort demonstrated thateven 
v/hen assisted by powerful, straightforward, and in- 
pensive software tools, novices did not make a 
sustained entry into a domain when they worked on 
their own. Although these novices did not have dif- 
ficulty with thesoftware itself, theirlackof experience 
uith the domain prevenied them from using the 
software effectively. At the same time, however, this 
early research determined that novices could use such 
softwaremostproductively when they were presented 
v/ith an inviting task and -.'onsiderable help. 

Hcieisan example. We asked noviceadultstouse 
a music composition computer program to solve a 
mm iber of simple hai mony tasks. We (and the subjects 
liiemselves) were surprised to find that even with 
Mtle musical training these beginners could solve the 
problems quite proficiently. However, when we then 
posed a more open-cndod pi oblem, likccomposingan 
original melody, v/e discovered that our novices were 
much less successful. Even with the computer as an 
aid, thiCy could not tackle the more unstructured 
problem effectively on their own. 

We took this research finding as a starring point 
for the design of computer-enhmced projects that 
v.'ouK? enable novices to work effectively in a new 
dcM-nain.lliree prototype Catalyst projects have been 
developed in the past year to test this idea. What 
followsisa descriptionof these projects along with the 
principles we used in designing them. Our current 
research initiative, also funded by the Markle Foun- 
dation, is to evaluate the efficacy of these projcxrts. 
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Design of the Catalyst Projects 

Each CiUalysl project consists of Ihroo ossonlial conv 
poncnls: 

1. A powerful software tool. Each project is built 
around a powerful coniputer program. We select soft- 
ware that is inexpensive, readily available, and px)w- 
orful enough for professionals in the domain. Ex- 
amples include music composition tools, computer 
program editors^ and word processip.g software. 

The software tool reduces the barrier posed by the 
prerequisite :L..alls that make upthecraftof thedomain, 
which an expert would hone through yearsof practice. 
In music; for exairplc, th*e computer produces the 
performance of the composition and can even flag 
several kinds of syntactic errors. 

2. An on-disk library. Each project contains de- 
tailed information in the form of computer files, hi the 
projects described below, this 1 ibra ry ca n con tai n songs, 
programming procedures, or historical information. 

The library of examples in the project gives the 
novice ready access to a repertoire of experiences, 
examples, or illustrations relevant to the problem at 
hand. The expert has internalized this repertoire 
through experience. 

3. Strategies and instructions. The project also 
provides strategies in the form of slcp-by-stcp in- 
structions along \v ith export advice and sample bohi- 
tions. 'Hie u^er follows these instruction^ to con^.plele 
the project. 

Thestrategiesand instnictionsof the projcc tguide 
the novice through the solution of the problems in- 
herent in each step of the task. The ability to find 
etfective solutions to common pioblenu quiLkly »s the 
hallmark of expert problem solving. 

Three Illustrations of Catalyst Projects 

Three projects that meet these criteria have been cre- 
ated and are currently being tested at Project Zero: 
SongSmith (Walters, Meyaard, & Scnpp, 19 J9); Just 
Enough Pascal (Walters & Morrison, 1988); a id Imuii- 
grant 1850 (Project Zero, 1990). 

Catalyst Project in Music: SongSmith 

The Project: To write a shoit potni (a iimerick) 
and set it to music by composing an original melody, 
duet part, bass line, and chords. Working alone, an 
individual with moderate musical experience can 
expect to spend 10 to 15 hourscompleting the project. 



The Computer Tool: Deluxe Mu>u: Conshudi '^i 
Si'i (Electronic Arts), an ii\expensive but powcrlul 
nuisic editing program that can perfomi the compo- 
sition in up to four voices using a variety or synthe- 
sized timbres, and can print the composition as sheet 
n\usic. 

The Library: Examples of good solutions illustrate 
eachstepin theprocessof writing a song. Illustrations 
from experienced composers link the task to mvMC 
history. Using nontechnical language, the project ,\ho 
makes connections with concepts in music theory. 

The Instructions: The project guides the user 
through a step by-step process of writing a song. It 
begins with the task of creating the lyric and setting it 
to an original melody. The projovt concludes with the 
creation of harmony with a bass line. 

The Sotig Smilh project poses the central problems 
of music composition — text setting, voicing, contour, 
and harmony. It offers a chance for the beginner to 
explore var ous solulicns to these problems and 
structures theexperience in such a way as to guarantee 
a product (an original song) as an outcome. 

Catalyst Project in Programming: Just 
Enough Pascal 

Ihe Project: To assemble the Pascal program 
"CridWalker" — a game in which Mnall creatures in- 
telligently find their way through mazes — from a s<.'t 
i)f [*ascal procedures supplied v/ith the project. An 
induidiial with no Pascal prugramirang experience 
can complete the project in about 25 hours. 

The Comput'.r Tool: THINK Pax.il (Symantec), 
.an integrated system for wilting, ed.aini.;, and de- 
bugging compiled Pascal programs. The debugging 
features of this development system pinpoint many 
of the the novice programmci^s errors. Special win- 
do wsgive^he programmer vahiableinformation about 
the current state ol the program and display the values 
assigned to variables at any given point. 

The Library: The kit includes all the necessary 
Pascal pieces to assemble the complete pro^.ran'i 
CridWalker. These program pieces are also fully ex- 
plained in the accompanying m.anual. 

The Instructions: The ]u$t Fjiough Pascal kit pro- 
vides concise iru-lructions on hu^v to assemble the 
pu:cei>ofPabv.alcoJcinthoedUor.lhekitaboinLiUus^, 
instructions for ''tinkering' with the program,making 
tlioso changes to the program that reveal important 
underlying concepts such as loops, variables, condi- 
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I gram dosi^^n and issuos ot use/ inlorfacf. 

Io(.kal prOi>rar.m^inj> through the pnxv^s of In; ihiing 
.M\ el Vooraie pro-rar.i ouq s'.cp M a luno. 

Caiolysi Project in Social Studies: 
linmigrcnt 1850 

Vhe rrojcct: To explore the c\pcr.ei\ecs o\ iho 
hi hiu^miiyanlsloBoc^lonin KS50by makin';(he'xime 
i.\ci inns [Iw-c uiMiii^^ranls made when ilu^v anued 
VA t!ur Uniled Slal-s. After a brief inlrodm lion lu ihr 
eoiv.puler .sofluaie, an ludiMdual can eoinplete il>c 
projea u\ > hour:;. 

The Computer Tooh hither Mieiv)t^oU Woiks 
iMiciwH fi)ui AppleWo:]..^ (Apple). Tho'.e:ntej;rated 
pro^yams nwhade mudul-j.s for word proco>>jng, da^ 
h;ba^-o, and spre.id^heel calculations. 

The Library. inur.i^^uU 1S50 proviOLs a con.plete 

of the -.^,uai passeni;er:. of four bhips that anivvd 
in Foi,ton uoiu Irela.id iU IS.^-O. It aln) pio\ .dcs infoi- 
maliuriabMul.jvanablejobsdoLalion, wap^es^nece^saiy 
experience), housin- (]ocat:on and rent), and trans- 
fH>rlal':on cobls of (he time. A spreadsheet doaunent 
displays a m.-^rket basket ol toad and (.lolhuv> prices in 
1850. 

The Instructions: The project ])o.<es the problem 
of adopting or.e family ironi ihe passenger Iisi, and 
Hulking a^'cral ui^pprlaht decisions for that lautily ■- 
fmding tlicm a place io h"\e, jobs, transpoitalion, le'od. 
The use! s record the ^e du ;^ions \u the family djary (a 
word-processing document) and they summarize the 
family budget (n^ a spreadsheet. 

*l he hhwi^nuit prujLij takes on many aspects of a 
simulnion in a game-hke format. In vsork ng through 
the project, the user makes decisions and reviews the 

results. niefulUmpaclofeachdc^ribioncanbcassessai 
by pkv.'ing the game a second time and making ]v,r- 
tieuKir decisions difierci.lly. Immigtarit also demon- 
strates how structured information accesscxJ through 
apo^•erfuilooica^leused togalherinsightsaboulan 
historical era. 

1ne/?/;/?/;;;:u^i/projV\lpfuvidcstheuuiivu]u^ 
"raw" or unstructured information about a period in 
history, a.\i the individual uaist oiganize that mioi- 
mation to make decisions and to generate uvsights 
about the period and the social grou]) that is beuM^ 
studied. 



ThcM^ Ihicx) Calaivi^t projects were designed to give 
novices fir:,lhand experiences with the nuterials and 
problems in three domains. At the end of each project 
the novice has crc ited a finished piece— a song, a 
computer program, or a diary. This product provides 
1 "slake" for the student, the motivation and context 
for following Iheinstructionsof the task. Forexample, 
mSorigSmith Ihediioissionsof musical notation, terms, 
and concepts are presented in the context of an 
individual's own einerging song, hi Just Enoui^h luis- 
cal, the student creates a computer program, and in 
hnmv;mni IS50 a periional diary of experiences. 

These three examples are different from the 
FROiT'.I. projects in soiue in^iportant ways: They are 
not d(Signed to facilitate assessment; they are not 
designed to fit seamlessly into the school curriculum; 
and they make exjMicit use of computer technology. 
Nevertheless, the Catalyst projects offer important 
features for our assessment j^rojecls by illustrating 
how i'>rojects— sustained activity on a single problem 
to produce an outcomc^-can lap inlo specific inlelli- 

gencesand reveal howindividualsapproachlhe&ime 
task differently. 

Designing Projects That Combine 
Technology and Assessment 

Asa partner in IheCenterforTechnology in Education 
at Bank Street College, Project Zero researchers arc 
developing assessment insliuments that make the 
best possible use of technology, hi our approach, 
technology functions in two distinct ways. First, 
technology is used directly in solving the problem at 
hand. For example, the music composition software 
actually performs the composition as it is being writ- 
ten, allowing the composer to judge by ear the quality 
of the work. Writers can use outlining software to 
study and manipulate the structure of an essay and 
use word processing programs to simplify the task of 
rewriting and editing a manuscript. 

Ta-hnology operates in a second way in the as- 
s»?ssment of student progress. The computer "opens 
up" the process of problem solving^ making it more 
visibletobolh the problemsolverand to thccvaluator. 
For instance, students caneasily revise and save draffs 
as they complete them for la ler review. When students 
work in small groupsat the computer, their decisions, 
made visible on tne computer screen, can be easily 
observcxl by both the members of the group and the 
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to.Klior. in those wa) u?in^; tnccon^pmor t<n • ur.posc 
alkn\> Ihc bUidcnt mw\ tho cvah alor lo sluJv -.liO 
puK' o\ CO .po^iliun as \v.*il as Ihc m^al [. loviial. 

iiology a? a fa^ilitalin^; inblrumcnl aiul that build ^.ii 
dc5ij;n j-jrinciplc:-) du .vn fioni IIh' ilicurv of niul- 
liplo iiUolligciKcs, \\L aic ncaling d'Uiuin paijL\ls 
lhal embody fLaluro.-* tak'jn fioia Iho projicts m boih 
H^Ol^i-LandCaialysl: 

• Assoi>i>mciU ii> drawn (wm sauiont perior- 
nvinccas ihcy com plol*^ pi ojccL^ {\\M iouisoii 
ceiUral issuls in the cunicuHini. 

» 1 0 a'jmplctc a prc-icd, il c student cicato-j uno 
oi more orir.inal produLl^. 

• A^sossmonl incliido^ both iutornn ap.d linal 
evaluations ot bludont product. 

• Students evaluate tlieir .nvn woi k Ihroui;! .out 
the project and compare these self evalua- 
tions \^'ith the teacher's judgments. 

• The con^puler \i> an indi:>ponsatie tool vvhkh 
students learn to luse effectively duiiUi; the 
project. 

Domain pro;Oi.ts dcssgrxd to these spv\ lUcatioiis 
allow students to work dire*, lly with the materials ot' 
the domain. 1 hese pu'jc^ Is po^e pit)]iloni*> that can" be^ 
M)lved ma \ niety ot'diffeient ^ay I hey piovidean 
oppi^rtunity t\'r siudcnts to develop a stake ui the 
outcome of that problem solving. Fmally, prsijects 
designed m this way mcorjXM'ate te<.hnoKH:v as a tool 
that facilitates pioblem solving in Ihctlomain.Thcu-.c 
of technol(^gy ojvns up the process ni <.oi'ep]eling the^ 
pivojuct t.> as^0^^ir.eI.t. 

A Protofype Project 

'I hcdomain project 1550 provides a stnrtuig 

point for developing one such dor ain project. Like 
the otlKT Catalyst projects, htm i^rrnt JS50 uses a 
powerful computer tool (Apple Vorks) to analyze in- 
formation. The design of theassessiv.entcompenerais 
drawn from the domain p>rojects constructed for Arts 
PixOrifL. }3ccause we are prescnl'ng this project as \ 
prototype, we woul.l like to dt'^scribe it in a little more * 
detail. 

lu the Jmtni^ratit 3^50 p-.ojec^ Mudent? \\-c k In 
small groups. First, they examine th.e pa-*senger list ot 
a ship that arrived in Boston in 1850. Thus list includes 
the name,age,occupation,and country oforigin of the 
passengers, all of whom list Irebnd as their country of 



oii\v.n. Students so it ti^e list to divldo^ ib.o nini.es into 
gioups that might makeup individ'-ial families Tor 
CA unple, they find that the !isl<.ontai.v:>scvcriil adults 
with the same last name, but by u^ing iho age and 
ouupation information, the) can make dc\ision:>ab<.»ut 
N'shich individUiils might plaui ibly be con.sidered a 
Inmily. Hach working gioup ''ad<)pt5" one family and 
begins to make a niinii;er of dei isions from the j>oint 
of view of this adopted family. Students begin a lirst- 
peison-accoimt diary for the family, which desciibes 
ihoir voyage, their arriv al in Boston, and the family's 
plans for the I'liture. 

iVext, the students peruse other database docii- 
ir^ents. Onedocument hsls jobs that were available in 
Hoi-ten during that period, mLludiU); the location of 
each job, the wage it pays, and tlie skills required. A 
M '.(uul database records typical housing, its location, 
cost per week, and a brief desLiiption of the property. 
A third database rovers the costs of commuting from 
one location in the city to another. Using these three 
VI u rces of information, the student s make the decisions 
that their adopted fanuH^ had to make. The students 
locate their selected jobs and housing on a map of the 
Doston area and they cakulate how much it would 
lusl and how long it Vvouid take to commute from 
home to work. Usingaspiead.shi.vtdocument,students 
"piirchase" food and dry goods supplies for their 
adopted family. As they select items from the list, the 
spicadsheet calculates the total cost. 

With all ot this information in hand— family 
ircmbersand their ages, jobs and salaries, the location 
an.l rent of hon^irg, the cost of fo -u and clothing, the 
dl^^»oce and charge^ for lransp >italion — students 
e« g:n to calculate a yearly budget for their family. 
I ney enter ail oi tb.c information they have gathered 
.nto the budget spreadsheet, wluch then computes the 
lOFUJts of these exjxMiditures over the course of one 
year. Studer.ts examine the result, and if the family is 
l'.):,ing money, they return to the other documents to 
rcLonsider their decisions. 

For example, the .students may decide that the 
chiidien 'n the family should be Sv^nt to work in 
factor.cs instead of going to bchooi. Or they might 
bcnJ older cluldren to work as servants, because these 
i'.bs p^y room and board in addition toa small wage. 
1 l\o ! ':nts in tlu^ family can decide to work six days 
a v\^ek instead of five. The family may select less 
expensive housing. In this way, the students adjust 
their decisions for the family so that income and 
expenses balance. 
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i' 'o!)' ' il'^ I'lC (.^(.'t isj, MstM^MfH'T 

J ' i with piiiili'J ^ d v!c;n»\;nij lnr 



''''^ ^ \\')A :\i\v lii viy rir.lJror. 
' , In.Tvi -Kv;Io >MUMl (n\:nv 



i-^••pp^ ^-.*'\^\.^{hvrM[\\l[\c^. l[)OIU^ 

,^lt:v!vf*N r-- ,v:\v • ^ u TtU'n fo: i!vj iiish irn- 
iiii):r.:'il 'J ui, , pcJKvl ,.i.d 11:0 >c :ikh!oI> 
toi win '..Mht'i, .',vniic\\ jpors. In anollior Kv, 

Insh-\p iK'ii ' i : J ;ivrtUi..iiv sl'.idcnb nMnpau* 
Shjcionr [Vo:!i:c;:> 

^''^^''^ piM'. is'>fll T uoLLsions by vMitir.i; .) 

J' f[(Mn 1. ^ . i , f \ if w ol one ; icnii^cr [hv\: 
^u•pl i .vni',. 'In i\Mi\plctL^ this diarv, i^tiklonls 



: - pp'. - ii niUiO.riiK ! inf-o; .i\iiion Ihcy .ttv pj\ cn m 
li e variv> .JaUb.> ; \viil> hi.sloricaiiy reaiiblic bul 
!iclii^:\i! .iof iiN. In v. iiti;v.; this diary, students oxu:- 

S'li'i'.v,: . u j;(o a xx-^ond cssiy as an i.istoiian c: 

-i' P' '«^'d/IheqviL'SlionstbuUi;uidcdi;s 
pic oin 1.' r.v^ 

bi Um.:i.^,i 1 



u. Jjiionai iv^scarch. ivrcvamj \c,j 



^'.oLilJ boa ^ked locxpb.in why v) 

tui.;\ ,nu( b;'.\ i.\:rji\\il rhanj^cd tliocily. 
''io.^>i^s, v'r tniild bo a^kcd toexplaiii wliy ib.> 
ii:im!,;:.Mu l^w i \^.b.r:o ihry did^ni.d lospccuialc. n 
whal ini^ ici . ddin- a [i\>\ky <;y,s{om lo tlioiily nii-hl 
liavo.or how pajwdico knvard llic iinmiVmnls wa.s 
n-arufo^U'd. 



ilia tinid wnl-r.p^ as> :; jv;H>nt, J ' idv:V > (^lai^idiM' 
tpio^lions about iht^ ii^ iIm^. j'or cxai ^yl:, {\ry 
en how ll\cy j ^ v,c\ ; b.r^w t ^xlivi iy 

tMcir p,rL''j) Uinc(uMV\], and wh >t llv^ \vonld d.> 
t^hflVivnlly if Uuy were lo k tj\n'ni;h the \ \ 
•-<xr'p,dl]nio/rho)"i.)iv - { \\bK-ainL.i.ti,.:iu'Ubtais^"i.i; 
tnunlhoi^i'! !ib5lion, aowlhcpicjA t ' a)uld( ha.. 
il thai ink. nnalion \s as.idiiv'dA;.-, uu'ydJx'nr^shtMva n 
ijnini,^;i.jiU'b (^>p.ori. nuMvuiay anitpaico with tb. il of 

iri^li Muiai^^ranLs 1 10 y.v.is a,,v\ 

lochniquos for Asscssmcnf 

iiiKO dirfcr<T.i U\I">niv]nos aio buMpju to b^ar in 
a^st- siny, this5ivulonl\\c^ik:(n r\ ahja»itMU>i'djo tlucc 
wiilk^n pia( s; (2) ax.i\.Mr«cal of ^/(^ .p work iK^in-.; a 
clavl^hsi: ' (3) n;v!Ow of sii doiU-/ St It'-a:. .L-^snnnt 
at !i\ I'lKT-. 

Wnnen Work 

/\< tL\KlKvs road tb.c written \\(jrk, ib.ov ofkT several 
CLifK: pomtb for inipiovcn^'oi. Studora^ redraft the 
asmgniPcnl taking tl\e:-<^ poir.r, ij.lo account, and the 
nowd.'altisiy aded. Checkh;>t,soi wMlmgpcrfoni\in(,e 
nsed \i\ Alls PROri!!. la^ks wsil be adapted lo thi^^ 
portion of tlie a.s^\sMnent, A.sin Art' TROPliL \vnlin;> 
a .sii^nnK-nts, sUidcuts create a portfolio of drafts that 
lead lo liu' coinpletitm oi the finislnvi piete, which 
they use whtni lofleotin^; on ehan^^x^s in tb.eir writing. 

Checklist on Group Adlviflcs 

In a second a^se.ssment teJ^nitjiie, ihe leach^ r l vahi- 
afe3 b,:w tl;e various tean> of i-.ttuk nS f-nt tion as a 
i;ioup to accomplish t!ic assi;\ned tasks, 'to lacihtale 
t!a^ the teacher u:;cs a diUiT d checklist to recoid 
peilinent uicidenls and ii;ter.ielion>. 1 ne r-spects of 
group work that are on this thcckli^t include 
iracrpcri>onald)'naniieN^roupefhcit.i*.cy.andcrealivity 
ii^ problem solving, l!exibil-ty of rv>los, and res;>ou- 
sivc-noss to suggcbtions. 

This checklist is i:npo!f int ior veral iea^U)ns. 
rirst,ilattoin)>tstocaptuietheio!< Ipe^v^^^ald^^lau\;c^ 
oi the pn^joLl, wh ch may othei w rouviij^ urdetrc- 
ted becaii^^e studer.ts r 'lely {'vuwa' i.t :»por.laniA)u^ !/ 
on ' iwh itatuiLS of th',"ir ^.'oik lu ihrir own w:ilii>^^, 
Sectuui, t!)eclu\ klistgi\'ei> tt-e tea, h. r t]\C( -ppoi ti:n;;y 
to step back from the ( lass and ot',^'r\e c!asi,ro,'m 
interactions in a strucluied and pu:po.-,efnI janner. 
The checklist also provides the tea».her a clvuicc to 
observe d.e work ol students u ho n^av not vvj ite well 
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i. i.u'tion linui ilUMi , :\\\ a [ .is lii l^ -Ji i^- 

lie \<'iN tin ; ,\, \^iih 

ii. '.'i.' t<.\i> her' u u^. :,S .-lui - iii-.r;. ^ii' rs Xiilioc^'.! 

in tMc r'/M'^^l \ iiu' kO'i.pse what > 

;p^U-f a' , ■ i ; rc i ^. Kk^n- tl^ * kI 

i-' '.s: 'POf - i'< !:.v *al'Mt\ >' lb ''\ U)^ \» to^v.h ' .1 



^♦:."!l'I>1-J >i v. . i'MSmllu .1 al'(*!i 

b, -'^i.-li: .a.-ii: .liU-'v 'u',v ^1 llicn* a<.^"Oiap:i.sh»'H m' » 
ar,.: tow [" • : .o/: t 1'. io il.it, tl.cv P.^' t 

«' 'T ' jp>-' .1 \i I i.v . \S C r( M'N* 

lj(>5i,^tw;' n(^^ 0 pixi'iiu^ ;Iv,7L\^nl)o \i l\1 io 

mii.J, inl'r.cpi . utvuK iil^ work \> uliihcniulcii it.. 
I'f soc:.,l 'liKi. ihv' historical rcoordb and ^\ ku- 
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S ' :hv^ in dilicn'hU M*lM:n;u>ns. I'iv y can luobi- 
^ v.- iiic !oii;irai-fn.itl(«'nnvi i inlcli -'.mkc U) ai^aly/o 
lanlilativc Jala (M' 'o I*. * I tn^n /.i; uMiipctir.^; 
OS (»f ('\*ivi«"^k^\ il;i-yv in 'Ik' '.!\yaisliv' inlrl- 
h;,oiivo to iasl\in!i p*..i;"\hit wnitin ooLiiinonls Iho 
i'pL'!s)iial in^oli {{) ilv-vMc wilh [Uv'w 

[w KiUd [he ^p^lu/. inU. ai; oiH'o u\ lo<ali i';M^;h- 
} o/i^i>ovii; ('H a n«ap. 

Ahh(un;li Iho tlu oi v ot n.^Mlip'o inli^'Iliecncos in- 
M! ills lilo cio'-:>;n(^t Ihisas ir.riu }>roja I, it doosnol 
s{\ i>) ilic K^sw^} of iPo oTlual >s<^*^>n.k ' 1 11^:11. 1 low 
■ ; » >\c .'ivlinvjii^h lviue< 'U a-i " .J. opui^' ' oolntion (^f 
I ij 1 iiiiui^^i Av\ pa>bk-in fuM^,..;! "m^j Jt .)nalo''onc?'ro 
Lo:v.:jv rli isqno ^tu>i\, v/o \. ill follow I'pxici iki^Mi oiui 
i cilin:/ analysis of as omuoiU by CvMisuioring ihao^ 
i''ip<M lanl foam u sol i.\b:>-^>^mcn[:J:fCCi}iCi^$,SLope,?i^d 
/',Oi .p'lnvu 

i ir^t, as an a^sc'-sn^onl in^^lniraonl, Ihc dcuiuiin 
piojoot bIcMUk. learning and evaluation and it largcls 
J:ur:i\/ liio bk.lis and oner pis I ha I llie loachor wan Is 
Ua- Nl'adonls to Icain. I Vr ovamplo, in a >ocial studies 
okv^b, sli:dv nls a.re evaiu.itt:d < wi theii ability to gather 
aiid eollato infornialio^i, to analyze and mterprol the 
K suits, to get l.eip wlu ii rieeexSiUry, and Io write a 
di'.eriplion of what they have uivcovered. These are 
[^ii.. iseiy th.e tasks Ib.ey nuist jx^rfoini toeon^pleto the 

rerai:solhoskilks;^f iiUeie>taree\'aIuateddireetly, 
IhL' donvun [^ii';(vi aj^pioaeh to as\rssni nt slan-Jsin 
. -I'p eoniia.si to [\\c tra.iiilional (L'^t Ml ua' Wilh 
ill eel as^e:>^>IrlClll, both toad*..i ■ '":\ 'AiKKni lucust»n 
^^e skills tl ^n^.>*l\es;uvr <.>t, wjlh tests the teaeht. r 
nui >t nifcr thep ei^o.Leof (.ie^iroJ skilN fron.istudonls' 
J 'iL^rmanec oii ie:ts that ineasuie ih^Si^ skills ( iily 
ir.duecliy. \\']wn a ^indent ar.i>\versa n^eltii)!e-ehou e 
».;'io* ticMi c irei^liy, tlu: teacher must uifer froni that 
it.:ponse that the student has ^on^e nnderslanding o. 
d :e concepts tivUi'jrvV. id-^aba^i-^for llie correct answer. 
Tii! 0:ernuTe; as rrederjksen and CoMins p<nnt oui, 
in».iiic\t te,«iso! .-kills oflenleaviUudunts to eoncenti ale 
> n Ik.e skills that aru dii^^liy rt'laled to taking the te .1 
r''^. -(liaaen tin*'-' li'sib.af'.. n ordv 'oe infeiret.! fioiu 
iPL ie a.^. 

Se».ond, Ihc d^nrui pro]i\t asse:>suienl is iv.(>ie 
convplLte in i^copc than the traditu i\al test in that it 
aUenipts to capture niusl of what is Kquired to com- 
plete the desired activity. Inlei personal skills arc 
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